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1. INTRODUCTION 

4D medical images represent voluminous data where each image is composed by a set of volumes 
representing the 3D images of a human body part at different instants t, each 3D image is in turn composed by 
a set of slices. In the literature a lot of lossless 4D medical images compression works are realized to reduce 
images size without data loss in order to avoid diagnosis errors. Considering 4D image as a set of volumes 
evolving in time, the recent lossless 4D medical images compression techniques apply the techniques of video 
compression such as motion compensation in order to efficiently removing inter slices or volumes 
redundancies. 

Based on the advanced video coding H.264/AVC Sanchez et al. [1] described two coding methods for 
lossless 4D medical images compression. The first method exploits the redundancies among the 2D slices in 
(each volume) third dimensionz. The second method exploits the similarities between the slices in the fourth 
dimension time t. Redundancies through the fourth dimension are more numerous than redundancies through 
the third dimension; therefore this is the second method which permitted better compression ratio. 

For more exploit the redundancies in the four dimensions of medical images the same authors of the 
precedent work proposed a new compression technique based on H.264/AVC [2] as in precedent work. So in 
this compression technique multi-frame motion compensation is applied firstly in z dimension to each volume. 
The obtained reference and residual slices are treated secondly also by multi-frame motion compensation in 
temporal dimension, thus the redundancies are reduced in z and t dimensions. The final residual slices and 
motion vectors are compressed by entropy coding. 

Here multi-frame motion compensation applied to a set of n slices consists to consider first slice as 
reference slice intra coded and n — 1 slices as inter slices which are inter coded by variable block matching 
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and multi-frame motion compensation where each block of inter slices can be predicted from multi reference 
slices in z dimension in its first application and t dimension in its second application. 

Martin et al. proposed in [3] a new method of 4D medical images compression also based on the 
H.264 video coding where predicted slices are generated by using spatio-temporal reference slices from z and 
temporal neighborhood, where differently to precedent technique which realizes prediction in z dimension 
followed by prediction in t dimension, this technique realizes spatio-temporal prediction where each block of 
inter slice can be predicted from multi reference slices in spatio-temporal neighborhood, this permits to obtain 
a good results in compression compared prediction in z dimension or prediction in time dimension. 

All the previous cited works (based on H.264 video coding) don’t integrate progressive lossy to 
lossless decoding in their schemes. Other techniques apply wavelet transform indeed it can be combined with 
image compression technique as fractal to improve time coding [4] also wavelet transform is very effective in 
medical image and video compression thus a lot of works are proposed as in [5] the authors presented color 
video medical compression technique by using geometric wavelet in order to eliminate efficiently similarity in 
each frame composed the video sequence with good image quality but without exploiting the temporal 
redundancies. 

The first proposed works based on wavelet transform in literature for lossless 4D medical images 
compression do not integrate motion compensation in compression scheme thus in [6] the authors compared 
three techniques using JPEG2000. The first technique consists to apply 2D wavelet transform to each slice 
composed the volumes and compress it separately by using JPEG2000. The second technique is represented 
by two variants: the first variant is application of 1D wavelet transform in z dimension, the second variant is 
application of 1D wavelet transform in t dimension and for both variants the obtained slices are compressed 
by JPEG2000. The third technique is application of 1D wavelet transform in t dimension flowed by 1D wavelet 
transform in z dimension the obtained slices are compressed by JPEG2000. The exploitation of temporal 
dimension in second and third technique provides better results in compression rate because the numerous 
similarities in temporal dimension. 

Due to efficiency of the motion compensation in the video compression scheme to reduce temporal 
redundancies Kasim et al. [7] proposed a wavelets compression technique of 4D medical images based on 
motion compensation and integer wavelet transform, here the 4D image is compressed as a sequence of 3D 
images. This technique consists to achieve 3D motion compensation in order to eliminate efficiently similarities 
existing between volumes in temporal direction, after the resulting volumes are decorrelated by 3D integer 
wavelet transform. The obtained data are coded by 3D SPIHT. This method allows lossless coding and 
progressive lossy to lossless decoding. 

The first step is motion estimation inter 3D images. Where a group of n 3D images are represented 
by one key image (the first image in a group is compressed without motion compensation) and n — 1 inter 
images. Each current image (at position t) to be predicted is divided in cubes for each cube it most similar cube 
in reference image (at position t — 1) is found. The difference between the position of current cube and it most 
similar cube is motion vectors and the difference between those cubes generates the residual image. 

Thus the results of this step are 3D key image, n — 1 3D residual images and corresponding motion 
vectors. To reconstruct the initial group of images, the key image and the corresponding motion vectors is used 
to obtain predicted image which permits to reconstruct the first inter image by adding the predicted image to 
the first residual image, the followed inter images at position t are reconstructed as the first one by using inter 
image at position t — 1 and corresponding motion vectors. The second step consists to apply 3D integer wavelet 
transform to key image and residual images and in final step the key and residual images are coded by using 
3D SPIHT, also the motion vectors are entropy coded. This technique permits to realize lossless compression 
and progressive lossy to lossless decoding by transmission a part of bit stream of key images followed by a 
part of bit stream of each inter image this permits to improve progressively the image quality in decompression. 

All cited works of 4D medical image compression try to eliminate the redundancies by using different 
prediction techniques in t and z dimensions either by applying motion compensation or by applying wavelet 
transform or by applying both motion compensation flowed by wavelet transform. 

In this paper we propose a new lossless compression approach based on adapted filtering in inter slices 
direction to improve the elimination of redundancies in 4D medical images. This approach consists to apply 
2D integer wavelet transform to each slices followed or not by either wavelet filter or motion compensation in 
inter slices direction. The obtained slices are coded with 3D SPIHT. The experimental results are compared to 
two approaches: 3D SPIHT using motion compensated temporal filter in inter slices direction and 3D SPIHT 
(without motion compensation), the obtained lossless compression rates show our approach outperforms two 
other approaches. The rest of the paper is organized as follows. The section 2 presents prediction techniques 
used in video compression. The section 3 details the proposed approach of compression. In the section 4 the 
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experimental results for lossless compression are compared to other compression approaches. In final section 
conclusions are presented. 


2. MOTION COMPENSATION AND TEMPORAL FILTERING 

The principals video compression techniques used in 4D medical images compression are represented 
by two types of technique: H.264/AVC video coding and wavelet video coding. These techniques are based on 
motion compensation to eliminate the redundancies as in H.264/AVC coder the motion compensation is applied 
by using the block matching to attain the minimum prediction error which is the minimum difference between 
current block (to be predicted) and reference block in search window, also the reference blocks can be 
determined from multi reference images with variable block size. 

The lossless 4D compression techniques based on H.264/AVC offer good compression rate but 
without permitting the progressive decoding, the alternative is the wavelet techniques which produce scalable 
flux and realize good decorrelation of signal as presented in [7] where the progressive decoding is obtained by 
reordering of bit stream, the progressive decoding can be also obtained by using temporal scalability but it is 
not used here cause the motion compensation and wavelet transform is achieved separately. 

In order to obtain temporal scalability and efficiency eliminate temporal redundancies the recent 
wavelet video coding apply the wavelet transform in motion trajectory by using motion compensated temporal 
filtering (MCTF). In wavelet video coding the MCTF can be applied before spatial decorrelation with wavelet 
transform (t+2D) or after spatial decorrelation in wavelet domain (2D+t or in-band) flowed by entropy coding. 

The first works in video compression [8], [9] integrated Haar motion compensated temporal filtering 
where the images are separated in even images and odd images, the even images are low pass filtered and the 
odd images are high pass filtered, the obtained low pass images are also separated in even images and odd 
images and filtered till the temporal level decomposition is done. The filtering is realized in temporal trajectory 
determined by motion compensation to reduce the energy in obtained high pass filtered images. With the 
emergence of lifting scheme for the calculation of the integer wavelet coefficients, other works were carried as 
in [10] the authors defined two filters: motion compensated Haar lifting filter and motion compensated 5/3 
lifting filter ; the use of motion compensated 5/3 lifting filter gave the best results. 

The scheme lifting is achieved using two steps prediction and update: the prediction step retains 
difference between two samples of signal (high pass filtering) and the update step retains the average therefore 
an approximation of signal (low pass filtering). 

In [11] the authors introduced the motion compensated truncated 5/3 lifting filter where only the 
prediction step of lifting is performed, thus each high pass filtered image is obtained by determining the 
prediction error from neighbor reference images forward and backward. We propose an adaptive prediction in 
order to ameliorate lossless 4D medical images compression rate, we apply either 5/3 truncated lifting filter or 
motion compensated, if one of them minimize prediction error in inter slices direction. 


3. PROPOSED COMPRESSION SCHEME 

The first step of our scheme is formation of GOS (Group Of Slices) from 4D medical image followed 
by application of 2D integer wavelet transform (2D IWT) in spatial directions (x, y) of each slices, the second 
step is inter slices filtering of each GOS and the final step is coding of obtained slices, motion vectors and 
etiquettes. As shown in Figure | proposed compression scheme. 
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Figure 1. Proposed compression scheme 


We describe these steps in the following points. 
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3.1. Construction of GOS and spatial transform 

The GOS are formed from the slices of 4D medical image (x,y,z,t) as shows in Figure 2(a). This 
construction permits to obtain a set of GOS representing 4D medical image with each GOS is composed with 
nearest slices in spatial direction z across time. 
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Figure 2. (a) 4D Image composed by 3 volumes. (b) Construction of GOS composed by 16 slices (in 
gray) 


In Figure 2(b) the slices in gray represent the first GOS with 16 slices of 4D image composed by 3 
volumes, thus all GOS of 4D image are also formed with follow slices in the same direction used for the first 
GOS (across time), as the second GOS starts with slice 17. Next the formation of GOS each slice is transformed 
by 2D integer wavelet transform using lifting scheme [12] in spatial directions (x, y). This transform is 
reversible; it allows producing integer wavelet coefficients which permits lossless compression. 


3.2. Inter Slices Filtering 

After spatial transform each obtained GOS is filtered by the proposed filter in inter slices direction 
based on truncated lifting scheme and motion compensation. The motion compensated truncated 5/3 lifting 
filter proposed in [11] is realized by application of the truncated lifting scheme and motion compensation in 
the same time, the truncated lifting scheme achieves only prediction step of lifting scheme. The motion 
compensated truncated 5/3 lifting filter (MC Trunc 5/3) for the block Sz [m, n] can be formulated as: 


R[m, n] = Sk[m, n] — 10.5 x (Sk-1[M — dimn — din] + Seailm — dam n = dan] D 


Where Sk-1, Sk+1 : reference slices, and Sx: inter slice. 

R: residual slice (high pass slice). 

(dim, dm): motion vector of block Sx [m, n] to a position in Sx-1. 
(d2m, d2n): motion vector of block Sz [m, n] to a position in Sk+7. 


: corresponds to round operator. 


The motion compensation is realised by using block motion model so each inter slice (to be predicted) 
is divided in blocks and each block is filtered by MC Trunc 5/3. This filter achieves bi-directional motion 
compensation thus for each current block in Sx it most similar block is determined in Sz-; and in S+; and the 
difference between the position of current block and these blocks represents motion vectors, the criteria of 
similarities used is minimum sum of absolute differences (SAD). Thus each inter slice is replaced by two 
motion fields as shows in Figure 3(a) and residual slice. 
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Figure 3. Motion fields: (a) predicted block with MC Trunc 5/3, (b) proposed approach with 1: 
unfiltered block(E7), 2: predicted block with truncated 5/3 lifting transform(E2), 3: predicted block with 
motion compensated(E3) 


In our scheme each inter slice (to be predicted) is divided in block and each block is either unfiltered 
or filtered by one of following prediction techniques: Truncated 5/3 lifting transform or motion compensation. 
This filtering can be represented by three following prediction errors: 

The unfiltered block S;{m,n]: 


E,[m,n] = S,[m,n] (2) 
The truncated 5/3 lifting transform (without motion compensation): 

E,[m,n] = S,[m,n] — 10.5 x (Sx_a[m, n] + Skyilm, n))] (3) 
The motion compensated prediction: 

E3 [m, n] = Sk [m, n] _ Sk—1[m E dmn g dn] (4) 

Where (dm, dn): motion vector of block Sx [m, n] to a position in S;.7. 

Between the three prediction errors the minimum is chosen for determining the prediction error of this 
block S;[m,n] and its prediction method. 

The prediction error E; represents the unfiltered block S;[m,n], the prediction error E2 represents 
prediction step in 5/3 lifting transform and the prediction error E3 is the difference between block S;{m,n] and 


it most similar block in slice S;.; as shows in Figure 3(b), the motion vector (dm, dn) represents the displacement 
which allows minimizing E3. 


So each inter slice is replaced by one motion field (forward) and/or etiquette (to indicate which 
prediction error is used) and residual slice. 
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Figure 4. 3 levels motion compensated truncated 5/3 lifting filter for GOS with 16 slices 
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Figure 4 presents 3 decomposition levels of MC Trunc 5/3 for GOS with 16 slices; the number of 
obtained slices of MC Trunc 5/3 is the same to our scheme which is composed by 2 reference slices (1, 9) and 
14 residual slices (R1, R2, ... R14), the slice (17) represents the first reference slice in the next GOS. 

However for motion coding, the approach with MC Trunc 5/3 produces two motion fields and our 
approach one motion field (forward) and etiquette for each predicted block by £3 and only etiquette for each 
predicted block by EF; or E2. 


3.3. Reference and residual slices, motion vectors and etiquettes coding 

The obtained reference and residual slices composed GOS are coded by 3D SPIHT [13] (Set 
Partitioning in Hierarchical Trees) and generated bit stream is coded by arithmetic coder, 3D SPIHT is used as 
in video coding and volumetric image coding, it is a bit plan coder and it permits to reduce data size by 
exploiting the inter dependences of subbands in three dimensions x, y and inter slices. Concerning the motion 
vectors and etiquettes are coded by arithmetic coder. 


4. EXPERIMENTAL RESULTS 

We tested the proposed compression method with five native 4D medical images CT (Computed 
Tomography) of heart from two references [14][15] shown in Figure 5. Each one is composed by 10 volumes 
and the spatial resolution of slices is 512x512 coded on 16bits per pixel. However the volumes of each 4D 
medical image have different sizes: data of reference [14] Imagel (141 slices/volume), Image2 (169 
slices/volume) and Image3 (170 slices/volume) data of reference [15] Image4 (136 slices/volume) and Image5 
(120 slices/volume). 





Imagel Image2 Image 3 





Image4 Image5S 


Figure 5. First slices of each 4D medical image 


We compare the experimental results of our approach with MC Trunc 5/3 approach (3D SPIHT with 
MC Trunc 5/3) and 3D SPIHT without motion compensation. For all these approaches GOS are composed by 
16 slices formed as shows in Figure 2 (b). 
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After each GOS is transformed with 3 levels 2D integer wavelet transform in spatial directions (x, y) 
we use 5/3 filter. In inter slices direction of GOS our approach uses the proposed filter equations (2, 3 and 4), 
the MC Trunc 5/3 approach uses equation (1) with also three levels of decomposition for both. However 3D 
SPIHT without motion compensation uses in inter slices direction 1D integer wavelet transform with three 
levels of decomposition of the same used filter in spatial directions (5/3). The obtained subbands of three 
approaches are coded with 3D SPIHT. 

The lifting scheme is very applied in medical image compression with traditionnel filters as 5/3 but 
other new filters can be tested in spatial directions [16]. The motion vectors are determined by block motion 
compensation model with full search method, the search is effectuated with block size of 16x16 pixels in our 
approach and MC Trunc 5/3 approach. The Table 1 lists the obtained average bit rate for the lossless 
compression using two first volumes of each 4D medical image. 


Table 1. 4D Lossless Compression Results in bit per pixel (bpp) 
4D Medical Images 3D SPIHT MC Trunc 5/3 Proposed Method 








Imagel 5.19 5.23 5.10 
Image2 5.92 5.97 5.89 
Image3 5.39 5.45 5.36 
Image4 5.03 5.06 4.98 
Image5 4.53 4.55 4.35 





The results show our method outperforms the other methods for all test images. 3D SPIHT gives low 
average bit rate than MC Trunc 5/3 of 0.76% , thus the integration of the motion compensated truncated 5/3 
lifting filter in 3D SPIHT penalises the compression rate in MC Trunc 5/3 approach. However the proposed 
inter slices filter improves the compression rate (low bit rate) with average of 1.45% compared to 3D SPIHT, 
as well a net improvement is reached of the order of 2.2% compared to MC Trunc 5/3. 

The average improvement by proposed technique compared to 3D SPIHT is obtained by using image] 
thus we use it in following test. The experimental results presented in Table 2 are obtained by testing five 
different sizes of image1, thus line 2 represents lossless compression results of 2 first volumes of image1, line 
3 of 4 first volumes of Image1 and so on to the last line of 10 first volumes of image1, these different sizes of 
Image permit to obtain differents GOS by reorganizing the slices as in Figure 2 (b). 


Table 2. 4D Lossless Compression Results in bit per pixel (bpp) for different sizes of Image1 








4D Medical Images 3D SPIHT MC Trunc 5/3 Proposed Method 
2Volumes Image1 5.19 5.23 5.10 
4Volumes Image] 5.08 5.10 4.99 
6Volumes Imagel 5.07 5.05 4.96 
8Volumes Image1 4.98 5.00 4.92 
10Volumes Imagel 4.99 4.96 4.90 





The obtained compression rate by proposed method is better than other schemes for all images test. We 
note that the bit rate is reduced for all compression schemes while the number of temporal slices (at different 
time and with the same position Z) composed GOS increase. The results show a variation of the compression 
rate as a function of the number of volumes. The improvement of this rate by our approach is of the order of 
1.73% and 1.85% compared to 3D SPIHT and MC Trunc 5/3 respectively, while it does not exceed 0.11% 
between the latter two methods. 


5. CONCLUSION 

In this paper we proposed a new approach of lossless compression of 4D medical images, it consists 
in construction of GOS and each slices composed GOS is decorrelated in spatial directions (x,y), after proposed 
inter slices filtering is performed with minimum of three predicted errors for each block composed inter slices. 
The three prediction errors are represented by unfiltered block, truncated 5/3 lifting filter and motion 
compensated the aim is to reduce the size of residual slices. The obtained slices are coded with 3D SPIHT. The 
proposed approach provides lossless compression improvements by reducing the bit rates compared to 3D 
SPIHT with MC trunc 5/3 and 3D SPIHT without motion compensation, this enhancement is due to the 
integration of the three prediction techniques in inter slices filter. As future work, our approach offers the 
possibility to obtain lossy to lossless decoding by exploiting inter slices scalability also other 4D medical image 
modalities can be tested. 
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